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Abstract 

Objective: The purpose of the study was to deternnine what patients, 
professionals and significant others regarded as the nnost innportant positive- 
and challenging aspects of Pulnnonary Rehabilitation Progrannnnes for patients 
with Chronic Obstructive Pulnnonary Disease (COPD) and to gain insight into 
how such progrannnnes could be developed and innproved. 
Method: A nnodified Nonninal Group Technique nnethod was used in three 
consultation workshops (one with COPD patients who had recently undertaken 
a Pulnnonary Rehabilitation Progrannnne; one with 'significant others' of the 
sanne patients; one with secondary care professionals who deliver the 
Pulnnonary Rehabilitation Progrannnne). 

Results: Each of three workshops resulted in the production of approxinnately 
ten positive- and ten challenging aspects related to Pulnnonary Rehabilitation 
Progrannnnes. These were further developed by a process of thennatisation into 
seven broad thennes. The nnost innportant was 'the patienf, followed by ' 
physical health'] jointly ranked as third were: 'mental health' and 'knowledge 
and education'. The programme' and 'professional characteristics' were jointly 
ranked as fifth, with 'the future' being ranked as the least innportant thenne. 
Conclusions: The nnodified Nonninal Group Technique nnethod allowed the 
developnnent of a ranked thennatic list that illustrated the innportant positive- and 
challenging aspects of Pulnnonary Rehabilitation Progrannnnes for patients with 
COPD. These thennes should be core to planning future Pulnnonary 
Rehabilitation Progrannnnes, particularly if patients and carer views are to be 
considered. 
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Introduction 

Chronic Obstructive Pulmonary Disease (COPD) is a progressively 
disabling condition characterised by impaired respiratory function 
associated with physical limitations and psychological co-morbidity ^ 
COPD results in a reduced capacity for functional activities and 
performance of daily activities with a corresponding impairment in 
Health Related Quality of Life-. Current figures show 900,000 peo- 
ple have been diagnosed with and are receiving treatment for COPD 
within the United Kingdom'. However, due to under reporting or 
under diagnosis, the actual number of those suffering with COPD 
is estimated to be as high as 3 million^. Stopping smoking is crucial 
and is the only intervention that influences the natural history of 
lung deterioration, with current pharmacological treatment being 
aimed at reducing symptoms and exacerbations^ 

Pulmonary Rehabilitation Programmes are multi-disciplinary inter- 
ventions individually tailored to optimise each patient's physical and 
social performance. Rigorous evidence from randomised controlled 
trials demonstrates that Pulmonary Rehabilitation Programmes for 
COPD can improve dyspnoea, exercise tolerance. Health Related 
Quality of Life, and reduce the number of days spent in hospital 
and the utilisation of healthcare resources^' Pulmonary Rehabili- 
tation Programmes have been shown to be cost-effective and are 
now recommended for all patients who remain breathless despite 
optimal bronchodilators, irrespective of severity and age^'"'^. Pulmo- 
nary Rehabilitation Programmes are also being effectively applied 
to non-COPD causes of pulmonary impairment^^\ 

There are now specific guidelines and recommendations in the 
United Kingdom regarding Pulmonary Rehabilitation Programmes, 
including how to select patients, the timing and number of ses- 
sions, intensity and type of exercise, the key educational, psycho- 
logical and behavioural components, oxygen supplementation and 
outcome assessment^ ^ Research exploring the benefits following 
Pulmonary Rehabilitation Programmes has predominantly been 
quantitative in nature. There have been some qualitative studies 
with COPD patients, but these have focused largely on specific 
aspects of patient experience^ ^'^^ and barriers to participation in 
Pulmonary Rehabilitation Programmes or other self-management 
programmes^ There has been some exploration of the effectiveness 
of self-management programmes from the patient perspective^^"^^. 
However, none of these studies have combined patient, carer, and 
professional perspectives, particularly in an in-depth analysis regard- 
ing the long-term impact of Pulmonary Rehabilitation Programmes 
in relation to personal needs and issues such as perceived patient ben- 
efits, and expectations and challenges of Pulmonary Rehabilitation 
Programmes. It has been recognised that a better understanding of 
how Pulmonary Rehabilitation Programmes improve Health Related 
Quality of Life could affect the future design of programmes, 
enhance measurement tools for Health Related Quality of Life and 
more appropriately support the specific needs of patients ^^'^^'^ I 

Consensus methods are techniques used gain opinions and views 
from appropriate experts regarding the current position in a particular 
field. They provide a mechanism for assimilating and synthesis- 
ing information, particularly where published information may be 
inadequate or non-existent^'^. The purpose of consensus methods is 
to reach an agreement on a particular issue. Consensus methods 



can also mitigate some of the problems sometimes associated with 
group decision-making processes. In particular, where dominant 
views may lead the process and crowd out other perspectives^'^. 

Nominal Group Technique is one of the commonly used consensus 
methods within healthcare and medical settings. The technique 
was first developed as an organisational planning technique by 
Delbecq et al. in the 1970s-". The Nominal Group Technique nor- 
mally involves four main phases: a nominal phase, during which 
each individual silently considers the issues under deliberation; 
an item-generation phase, during which each individual discloses 
the results of their deliberation to the group; a discussion and 
clarification phase, during which the group assures itself that it has 
understood the items that have been advanced; and a voting phase, 
during which the items are evaluated and the issue is decided (e.g. 
a ranking exercise). Nominal Group Technique promotes individual 
contributions allowing each individual the opportunity to voice 
their opinions. Factors that would normally inhibit participation are 
therefore avoided and even the more reticent group members are 
encouraged to participate in all phases- ^ 

By adopting a mixed methods design, employing qualitative and 
quantitative methods during consultation with mixed stakeholder 
groups, and by including a modified Nominal Group Technique 
component as described previously^^, we aimed to provide a picture 
of the perceived benefits and challenges of Pulmonary Rehabilitation 
Programmes for COPD patients. Here we report the quantitative 
analysis of the Nominal Group Technique activities. 

Methods 

Following regional ethics and research and development approval, 
a series of consultation workshops were held between January and 
December 2012, in a District General Hospital in Wales, United 
Kingdom, serving a mixture of urban and agricultural communi- 
ties. The hospital delivers a regular Pulmonary Rehabilitation Pro- 
gramme which includes 18 sessions of outpatient multidisciplinary 
input from occupational therapists, physiotherapists, dietetics staff, 
physicians, specialist respiratory nurses, social workers and a smok- 
ing cessation counsellor. The content and timings of the Pulmonary 
Rehabilitation Programme is evidenced-based and is tailored to 
individual requirements and personalised goal setting. 

Participants 

We recruited across the South West Wales Regional Health Board, 
United Kingdom that serves 385,000 people and included patient, 
professional and significant other groups, to ensure we included 
a wide range of views, experience and knowledge of COPD and 
Pulmonary Rehabilitation Programmes. 

Patients with COPD who were currently participating in or who 
had completed a Pulmonary Rehabilitation Programme within 
the last 2 years were approached to participate in the study, with 
most being approached in their last Pulmonary Rehabilitation 
Programme session. Information sheets were given to patients for 
their significant others (husbands, wives, partners, friends, carers 
or family members) inviting them to contact the researcher if they 
wished to participate. Professionals who were identified as playing 
a significant role in the delivery of the Pulmonary Rehabilitation 



Page 3 of 13 



FIOOOResearch 2014, 3:42 Last updated: 14 JUL 2014 



Programmes and the treatment of COPD patients (occupational 
therapists, physiotherapists, respiratory consultants, respiratory 
team administrators, pharmacists, counsellors, psychologists, and 
specialist respiratory nurses) were also approached to participate 
in the study. All 20 participants (8 patients, 8 professionals and 
4 significant others) provided written informed consent. 

Study design 

Our aim was to gain an understanding of the positive and challeng- 
ing aspects of Pulmonary Rehabilitation Programmes for patients 
with COPD and to gain a consensus regarding what constitute the 
most important aspects of Pulmonary Rehabilitation Programmes. 

Consultation workshops 

Nominal Group Technique consensus exercises were carried out as 
one aspect of a multi-layered, mixed-method consultation during three 
half-day workshops (one with professionals, one with COPD patients, 
and one with the significant others of patients). Based on guidance in 
the literature for optimal numbers for qualitative group consultations, 
we aimed to recruit six participants to each of the three workshops^ '. 

Each workshop was made up of three parts. Part one began with a 
broad discussion that examined the nature and content of Pulmo- 
nary Rehabilitation Programmes through a semi- structured group 
interview. The second part involved more extensive discussion 
with participants. Having attended a Pulmonary Rehabilitation 
Programme, participants were encouraged, using personal exam- 
ples to describe what the Programme meant to them. This included 
exploring their perceived views regarding the benefits and chal- 
lenges of Pulmonary Rehabilitation Programmes and impact on 
patient Health Related Quality of Life. An adapted Nominal Group 
Technique exercise was employed in the final part of the workshop. 
The focus of this stage was to address the following question with 
participants: "what are the positive, and what are the challenging 
aspects of Pulmonary Rehabilitation Programmes for the treatment 
and rehabilitation of COPD patients?" During the Nominal Group 
Technique exercise, issues that were raised in the early parts of the 
workshop were refined and condensed into a list of approximately 
ten positive and ten challenging aspects. At the end of the work- 
shop, participants were asked to rank these aspects in order of sig- 
nificance (Steps 1-7, leading to Output 1, Figure 1). The generation 
of the positive and challenging aspects of the Pulmonary Rehabili- 
tation Programme using Nominal Group Technique followed the 
standard approach outlined in previous work^^. 

The data generated from each Nominal Group Technique activity 
(Output 1, Figure 1) were collated for each consultation workshop. 
Median ranks with interquartile ranges were calculated using SPSS 
version 19 for each of the aspects on the positive and challenging 
lists and a consensus ranked list was produced based on these final 
median ranks. 



Nominal Group Technique consultation of a Pulmonary 
Rehabilitation Programme Data Set 

7 Data Files 

http://dx.doi.org/10.6084/m9.figshare.928540 

V J 



Generation of themes 

Following the consultation workshops we adapted the Nominal 
Group Technique method as previously described-- in order to include 
an additional multi-group ranking round (Steps 8-10, Figure 1). 
The lists of positive and challenging aspects of a Pulmonary Reha- 
bilitation Programme produced following the three workshops were 
organised into a series of over-arching themes under which the pos- 
itive and challenging aspects fitted (Step 8, Output 2, Figure 1). 
Rigour was maintained throughout the process of theme generation, 
by adhering to recommended qualitative data reliability and validity 
techniques^^"^^. An independent analysis of the lists generated from 
the workshops was carried out by two of the study team in order to 
identify the key over-arching themes. This process involved dele- 
tion of duplicate items and amalgamation of items where overlap 
was clear. A final set of common themes was independently gener- 
ated by a third member of the team. This reflected and amalgamated 
the thematisations of the first two. 

Thematic consensus 

Following the generation of themes, all the original workshop par- 
ticipants were sent a pack of A5-sized cards. Each card carried a 
broad theme as a header under which were listed the associated set 
of positive and challenging aspects. As with the earlier workshop 
Nominal Group Technique activity, participants were asked to rank 
the themes in order of importance: with '1' representing the theme 
they regarded as being most important and subsequent ranks signi- 
fying the themes of diminishing importance (Step 9, Figure 1)-^. The 
ranked cards were returned by participants in a pre-paid envelope. 

The data from the returned cards were analysed using SPSS version 
19 in order to calculate the median ranks and interquartile ranges 
(IQR) for each of the themes. A final consensus ranked thematic 
list was produced based on these median ranks (Step 10, Figure 1). 
This was the list produced for discussion and dissemination ensur- 
ing veracity within the method and enabling cross-consideration of 
themes and aspects by team members from Stage 1 thematisation 
undertaken within a group setting, to Stage 2 thematisation, under- 
taken by individual participants, post-consultation workshop. 

Thematic template generation 

Notes and audio recordings from the three consultation workshops 
were transcribed. These transcripts were subjected to thematic 
and summative analysis to extract relevant information related to 
each of the generated themes-^'^l The detailed content relating to 
each theme was extracted from the individual transcripts and was 
built up to articulate fully the set of aspects that it contained and to 
clarify any anomalies or ambiguities-'^. The final output of the 
consultation workshop was a 'thematic template' that ranked each 
theme in order and that provided a qualitative in-depth elaboration 
of the content contained within each theme. 

Results 

Consultation workshops 

We recruited a total of 20 participants across the three consultation 
workshops (see Table 1). Thirty three positive and 35 challenging 
aspects of Pulmonary Rehabilitation Programmes were produced in 
total for the three workshop group. The ranked list for each of the 
consultation workshops is illustrated in Table 2. 
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1. "What are the positive and challenging aspects of Pulmonary Rehabilitation 

Programmes for the treatment and rehabilitation of Chronic Obstructive 
Pulmonary Disease patients?" Posed to three separate consultation workshops. 



2. Individuals write down their list of ideas 



3. Each participant in turn contributes one idea to the 
facilitator which is noted. The process continues until all 
items are disclosed. 



4. Group discussion for clarification and evaluation, similar 
items grouped and duplicate items removed 



5. Final two lists of approximately 10 positive and 10 
challenging aspects of pulmonary rehabilitation from each 
of three individual workshops 



6. The positive and challenging lists are ranked by each 
individual in the workshop 



7. Ranked lists of positive and challenging aspects of 
pulmonary rehabilitation produced for each of the three 
groups 



Output 1 



8. The final ranked lists are organised under broad thematic 
headings encompassing positive and challenging aspects of 
pulmonary rehabilitation 



Output 2 



9. Broad themes are ranked privately by individuals 
attending the original workshops 



10. Ordered thematic ranked lists are presented 



Output 3 



Figure 1. Flow diagram steps involved in the Nominal Group Technique process of the study. 
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Table 1. Summary of three Chronic Obstructive Pulmonary Disease (COPD) workshop 
participant samples. 





Study 
group 


Male/female 


Participant status 


Age 


Date of PR 
programme 


Year of 
diagnosis 


1 


SO 


M 


Significant otiier 


n/a 


n/a 


n/a 


2 


so 


F 


Significant otiier 


n/a 


n/a 


n/a 


q 
o 


oU' 


r 


Oiyi III ICdl IL ULI Ibl 


n/a 


n/a 


n/a 


/| 
4 


ovJ 


r 


Significant otliGr 


n/a 


n/a 


n/a 


0 


PROP 


IVI 


Consultant 
respiratory pliysician 


n/a 


n/a 


n/a 


6 


PROF 


M 


Consultant 
respiratory physician 


n/a 


n/a 


n/a 


7 


PROF 


M 


Pharmacist 


n/a 


n/a 


n/a 


8 


PROF 


F 


Occupational 
therapist 


n/a 


n/a 


n/a 


9 


PROF 


F 


Specialist respiratory 
nurse 


n/a 


n/a 


n/a 


10 


PROF 


p 


Ph\/c:inthpr?i niQt 


n/a 


n/a 


n/a 


1 1 


PROF 


F 


Administrator 


n/a 


n/a 


n/a 


12 


PROF 


F 


Dietician 


n/a 


n/a 


n/a 


13 


PT 


M 


COPD Patient 


73 


2005 


2005 


14 


PT 


M 


COPD Patient 


66 


2010 


2010 


15 


PT 


F 


COPD Patient 


54 


2011 


2011 


16 


PT 


M 


COPD Patient 


62 


2011 


2011 


17 


PT 


M 


COPD Patient 


66 


2011 


2009 


18 


PT 


M 


COPD Patient 


72 


2011 


1998 


19 


PT 


F 


COPD Patient 


69 


2012 


2005 


20 


PT 


M 


COPD Patient 


74 


2012 


2005 



SO, significant others; PROF, professionals; PT, patients; n/a, not available. 



Generation of themes 

Individual assimilation produced similar lists of common broad 
themes that were refined to seven (Output 2, Figure 1). The seven 
themes were: the patient, physical health, mental health, knowledge 
and education, the programme, professionals and significant others 
and the future (see Table 3). 

Thematic consensus 

Fourteen of the 20 attendees at the three workshops returned the 
packs of cards. Two were incorrectly completed, resulting in 12 
evaluable responses (60%). 

Following thematic ranking, the theme that was regarded as most 
important was the patient, followed by physical health. Jointly 
ranked as third were: mental health and knowledge and education. 
The programme and professionals and significant others were 
jointly ranked as fifth, with the future ranked as the least important 
theme (Table 4). 

Thematic template generation 

In summary, the patient detailed how the patient's health and 
wellbeing changed for the better over the course of Pulmonary 
Rehabilitation, and how patients were encouraged to gain confi- 
dence, to demonstrate a commitment to improving their own health. 



and to adopt a broader outlook on ongoing healthcare needs and 
expectations. Physical health illustrated how learning to breathe 
"properly" had a profound impact on patients, not only because 
breathing well is vitally important to their health and quality of life, 
but also because breathing "properly" is something that needs to 
be learnt. Mental health highlighted that bringing patients together 
enabled them to appreciate that they were not alone in their feelings 
and experiences. Knowledge and education emphasised the ability 
of Pulmonary Rehabilitation Programmes to create a learning envi- 
ronment, lasting for many weeks, within which patients are educated 
about their illness, and are able to develop new techniques to man- 
age and cope. In the programme, patients, professionals, and signifi- 
cant others all emphasised positive outcomes for patients attending 
Pulmonary Rehabilitation Programmes for the duration and in the 
longer-term: physically, mentally, and socially. Professionals and 
significant others discussed how patients regarded the profession- 
als as "caring" and "friendly", treating them with "dignity" and 
"respect", and that this created a welcoming and safe environment 
that enabled them to feel "cared for" and "at ease". With respect to 
the theme of the future, participants emphasised a plethora of ben- 
efits that could be directly attributed to Pulmonary Rehabilitation 
Programmes, including improved health outcomes, enhanced qual- 
ity of life, fewer hospital admissions, less time spent in hospital and 
consequently health care financial savings. 
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Table 2. Positive and challenging aspects generated by each of the study workshops. 



Group 


Positive aspects (n=33) 


Challenging aspects (n=35) 


Patients 


1 . Breathing properly 


1 . Lack of privacy (corridor walking test) 




2. Breaking tlie cycle of inactivity 


2. Poor communication between clinicians 




3. Relaxation 


3. Venue not ideal (physiotherapy gym) 




4. Self-help; awareness; empowerment 


4. Lack of funding 




5. Physical benefits 


5. Explanation why there is a delay/need to wait 




6. Mental strength 


6. Daunting experience at the outset 




7. Knowledge 


7. Lack of clarity about what the programme is about 




8. Control panic attacks 


8. Diet information (one-sided: weight gain) 




9. Legacy of the future (hopes, lasting change) 


9. Commitment-insufficient for programme 




10. Morale, self-esteem, feel-good factor 


10. Waiting (to get on the programme) 






1 1 . Poor state of information from GPs 


Professionals 


1 . Patient improvement 


1 . Waiting-time lists 




2. Life enhancement 


2. Capacity/space constraints 




3. Patient improved attitude to condition 


3. Lack of flexibility to run in other locations 




4. Graduated exercise 


4. Time wasters/patients who do not attend 




5. Multi-disciplinary team approach 


5. Drop-out rate high 




6. Patient education/demystification/knowledge 


6. Travel and financial constraints 




7. Complementary/holistic - more than just a pill 


7. Convincing patients of benefits 




8. Good evidence base 


8. Lack of staff resources 




9. Validation of anxiety and confidence 


9. Lack of time to improve programme 




10. Patient satisfaction/appreciation of service 


10. Inability to sufficiently individualise programme 




1 1 . Staff reward and motivation 


1 1 . Long term benefits still unknown 






12. Lack of follow-up 


Significant 


1 . Time for yourself 


1 . Coming for the first time 


Others 


2. Partner's enthusiasm and enjoyment 


2. Uncertainty about what to expect 




3. A learning experience 


3. Challenging activities 




4. Gaining confidence 


4. Personal motivation to keep going 




5. Knowing help was available 


5. Lack of funding 




6. Caring staff 


6. Not knowing the bigger picture 




7. Given sufficient time 


7. Being over-protective 




8. Friendships made 


8. Learning not to take over 




9. Learning to manage illness 


9. Poor relationships with GPs and staff 




10. Physical and mental improvement and independence 


10. Lack of GP and staff knowledge 




1 1 . Programme sustained 


1 1 . Worsening of the condition in the longer term 




12. Saving money for the health services 


12. No opportunity for future follow-ups 



The positive and challenging aspects within each workshop group list represent the ranked lists ordered by the individuals in each group. The 
aspects generated are based on direct quotes from the individuals attending the workshops. 



Discussion 

We identified important aspects of Pulmonary Rehabilitation Pro- 
grammes for the treatment of COPD from the point of view of a 
mixed population group of patients, professionals and significant 
others. Using a modified Nominal Group Technique exercise deliv- 
ered during innovative consultation workshops, we produced a 
novel ranked thematic list that encompassed the important posi- 
tive but also challenging aspects of Pulmonary Rehabilitation 
Programmes. 

There was a surprisingly diverse range of generated aspects (Table 2) 
across the three workshops. The professional outputs were focused 



on pragmatic service delivery, with a clear goal of patient improve- 
ment, education and attitudinal change. The patients focused not 
only on physical improvements but also on improving mental 
strength, morale and self-esteem. Although all patients were positive 
about Pulmonary Rehabilitation Programmes, they also highlighted 
the challenges faced by some of them in attending them, which 
included an occasional lack of privacy, instances of poor communi- 
cation, inadequate venues for certain activities (e.g. a public area of 
a hospital corridor to perform shuttle walk tests) and being daunted 
by the prospect of exercise and gym work. These findings are in 
accord with previous literature, which has examined the reasons 
for non-attendance on Pulmonary Rehabilitation Programmes 
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Table 3. Final themes encompassing positive and challenging aspects of Pulmonary Rehabilitation Programmes. 



Theme 


Positive aspects 


Negative aspects 


1 1 ic r clLlcl 1 L 


rclLIt!! ILo LJclll 1 ell 1 llll|JIUVt;U clVva.1 t!l Icoo ell lU cl|J|JI cUlclLIUI 1 


L^dUl ILII ly UAjJUl lUI lUU dL UULbUL dl lU dLLUI lUII ly 




Ul LI Icll UUI lUILIUI 1 


Pronrommo for tho firct timo 

r 1 uy 1 dl 1 II 1 lu lui LI lu iiibL liiiiu 




Patients gain confidence from attending Programme 


Insufficient commitment to Programme 




Programme supports self-lielp and empowerment for patient 


Time wasters/'Did Not Attend' (DMAs) 




Programme lielps patients recover aspects of everyday life 


Challenges physical ability of patients 




Patient has enjoyed the experience 


Lack of personal motivation to keep going 


r 1 lyblUcll nUdlLlI 


Duiiiy duiu LU uiud.Liiu piupuiiy 


Ph\/cI/^ol o/^tI\/It\/ 
rliyblUdI dULIVILy 




Control anxiety and panic through relaxation 






rdlllliy dl lU lllcllUo Uolliy odi l Ic [JliyolOdl LcUl II IILJUco lUI 






thpmc;pl\/pc; 






Patient experiencing improvements in own health 






Developing more independence as result of physical 






improvements 






Breaking the habit of feeling physically inadequate 




IVIcllLd.1 nUdlLlI 


(jadllllliy dl 1 lllipiUVUU dLLILUUU LU LlIU UUllUILIUII 


To U'ooo mo1"i\/o1"oH onH 'l/^^oo ooino' 
lU r\UUp IIIULIVdLUU dllU KUUp yUlliy 




Developing mental strength and confidence 


Controlling panic attacks 




Ability to live a more fulfilling life 






P vr~\or lon*^ I n n o 'fool r\r\r\r\'' fci(^tr~vr onH In/^roocoH conco /~vf 
CApUl lUI lull ly d lUUI-yUUU IdULUI dllU IllUIUdoUU oUI loU Ul 






bell UoLUUIII 






rUIUUIVIIiy II I ipiUVUI I lUI ILo III Ul lU o IIUdlLII 






DcLLcl oLdLc Ul IIIIIIU 




The Programme 


Programme saves health service money 


Uncertainty about what the Programme entails 




Programme is complementary and holistic in approach - far 


Attending Programme for the first time 




more than a 'pill' 


Funding for Programme 




Programme should be sustained 


Patient travel and financial constraints 




Gradual increase in exercise across the Programme 


Capacity and space for Programme 




Good scientific evidence that the Programme works 


Limitations to running Programme in small number of 




Patient and partner satisfaction with Programme 


locations 




Multi-disciplinary approach during Programme sessions 


Programme is not individualized enough 




r I Uy I dl I II I lU piUVIUUo LIIIIU dl lU 1 1 lUUpUl lUUI lUU lUI 


l_dUr\ Ul pilVdUy 




o 1 n if o nt ^thor 
biy 1 III lUdI IL ULl lUl 


I n o o o ri oto 1 \ / ohor^^H orofoooionol oi iH\lio onH ootiont 

II Idppi Upi IdLUiy blldlUU pi UlUbblUI Idl , pUUIIU dllU pdLIUIIL 




MppiUpildLU UUIdLIUII dl lU IIULjUcllUy Ul r I Uy I dl I II I lU bUbblUllb 


cooooc 1 d n\ r~\rof occ lo n o 1 c ootinn li inoh In oi\/m\ 

bpduub ^^u.y. piuiubbiui idib udLiiiy luiiuii III yyiiiy 






High drop-out rate 






Timp wa^tpr^/'Diri Nnt Attpnd' CDNA^'l 

1 1 1 1 V V do 1 O/ 1—/ \\-A 1 M W L / \L 1 1 V L-/ 1 N/\0 j 






Lengthy waiting lists 






Lack of time to improve Programme 


r rotessionals and 


rriendships made 


Lack OT statt resource 


Oiyi IIMUd.1 IL WLIIUlo 


rdl LI IcJI b cl ILI lUbldbl 1 1 dl lU Ul lJUyi I lUI 1 L 


Poor rci 1 otion c h I r~\c \A/Ith ^^Pc onH othor ctoff 
rUUI lUldLIUI Ibl lipb VvlLII orb dl lU ULl lUI bLdll 




K/liiltl H I c/^ I 1 i n o r\/ r^r/^focci^nol toom \A/ith n/~\oH_cU'II 1 miv 
IVIUILI UlbUipill Idl y, pi UlUbblUI Idl LUdI 1 1 vvlLI 1 yUUU br\lll IIIIA 


Poor oommi inlootion loot\A/oon ollnlolonc onH loot\A/oon 
rUUI UUI 1 II 1 lUI IIUdLIUI 1 UULvvUUI 1 UlllllUldllb dl lU UULvvUUI 1 




\^cx\ II ly oLdi 1 


Trusts 




Motivated staff 

1 V 1 LI V ClLv^ V-J OLClll 


Onnvinrinn natipntc; nf hpnpfitc; nf Prnnrflmmp 

\_/ W 1 IVIIIOIII^ k-'ClLlv^llLO ^1 kyv^llv^llLO \J\ 1 iv^yidllllllv^ 




Staff feeling rewarded by the Programme work 


Explaining delays to patients of getting on Programme 




Programme provides time and independence for 


Significant others being over-protective of patients 




significant other 


Significant others learning not to take over 




Patients know that help is available 




\ lie ruiure 


rUblLIVU lUydUy Ul riUyidl I II I lU 


^tri loti iroH follovA/ i ir^ lo not offoroH 

ou uuiureu Toiiow-up ib noi onereo 






\A/oroonino of oonHition in tho fi iti iro 
VvUlbUlllliy Ul UUllUILIUII III LIIU lULUlU 






1 ono form loonofltc ctlll i in^noxA/n 
l—Uliy-LUIIII UUIIUIILb bLIII UllrxllUVvll 






1 ooL^ of fi inHino 
LdUr\ Ul 1 Ul lUII ly 






^1 iQta ina hi 1 it\/ of Propirammf^ 
oubLdi 1 idUl 1 1 Ly Ul r 1 uy 1 dl 1 II 1 lU 






Post-Programme assessment is not conducted at 






one year 


Knowledge and 


Programme provides knowledge and patient education 


Lack of clarity at outset regarding what the Programme 


Education 


Good scientific evidence for running the Programme 


entails 




Provides a learning experience for all concerned 


Lack of General Practice staff knowledge about 




Knowledge and information helps individuals to manage 


Programme to support patients 




their illness 


More dietary information required about weight loss 




Demystifies the condition 


rather than just weight gain 




Being taught how to breathe properly 


Lack of clarity at outset of benefits of the Programme 




Learning how to relax 


Not being fully informed about the potential delays in 




Patients passing on knowledge and skills gained from 


starting Programme 




Programme to others 





The positive and challenging aspects encompassed within each theme are based on direct quotes from the individuals attending the workshops. 



Page 8 of 13 



FIOOOResearch 2014, 3:42 Last updated: 14 JUL 2014 



Table 4. Final ranked thematic list (n=12*). 



Ordered 
rank (1-7) 


1 ncme 


Median rank 
^iniercjuariiie 
range) 


1 


The Patient 


1 (0) 


2 


Physical Health 


2(1) 


=3 


Mental Health 


4(1) 


=3 


Knowledge and 
Education 


4 (2.5) 


=5 


The Programme 


5(1.75) 


=5 


Professionals and 
Significant Others 


5 (2.25) 


7 


The Future 


7(1) 



*Based on 12 evaluable responses. Total respondents=14 
(14/20=70%), 2 were excluded from analysis due to 
incorrect completion. 



Interestingly, the significant others focused on the social elements, 
with friendships made, caring staff and individual care contribut- 
ing to the patients' gaining confidence and learning about how to 
manage their condition. The significant others also highlighted the 
knock-on-effect of allowing them to have more time for themselves 
and not be so protective of the patients. All participants recognised 
that they were unsure what the future would bring in terms of long- 
term health and health-care support, but were keen for continued 
contact with professionals. Pulmonary Rehabilitation Programmes 
refresher courses and for the Pulmonary Rehabilitation Programmes 
to be recognised as beneficial for others, and thus maintained. 

The final outcome of the Nominal Group Technique exercise was a 
ranked list of seven themes (Table 3), with 'the patient' ranked as the 
most important theme, followed by 'physical health'. Overall, the 
main positive benefits of Pulmonary Rehabilitation Programmes 
were that they instilled confidence, enabled patients to breathe 
properly and manage their health more efficiently, encouraged the 
patient to be more self-sufficient and in control, and were enjoy- 
able. The challenges to participation were that Pulmonary Reha- 
bilitation Programmes were daunting, physically challenging, 
and required motivation. Interestingly, many of these challenges 
have been highlighted in previous qualitative studies with COPD 
patients as important reasons why patients decline entry or with- 
draw from Pulmonary Rehabilitation Programmes. Patient beliefs 
about Pulmonary Rehabilitation Programmes can comprise positive 
aspects (e.g. that they will lead to improvement, safe and multi- 
disciplinary setting, and motivation) as well as negative aspects (they 
lead to disruption of normal routine, being tired, transport issues and 
limited privacy)^'. It has been shown that attending a Pulmonary 
Rehabilitation Programme is associated with better management of 
breathlessness, which in turn has a positive impact on physical and 
social activity, coping strategies and patient confidence ^^'^^'^ I 

This study was carried out within one geographical location in 
South- West Wales, United Kingdom, and employed only three 
consultation workshops. Whilst we are confident that the methods 
adopted are transferable, in line with our extensive engagement with 



the methods in a range of community and primary care settings^^'^^, 
a larger study, employing more consultation workshops conducted 
over a larger geographical area is necessary to consider whether all 
the important aspects of Pulmonary Rehabilitation Programmes have 
been revealed, and whether the themes we identified within this study 
are generalisable. 

The adapted Nominal Group Technique exercise was a mechanism 
for distilling the important aspects of Pulmonary Rehabilitation 
Programmes in a mixed group of individuals, which allowed the 
views of all the participating groups to be considered as equal. 
The process of qualitative elaboration of these themes in terms of 
what they meant to patients, professionals and significant others, 
provided a more comprehensive picture than other studies have 
derived. Moreover, combining qualitative with quantitative assess- 
ments provides more information, and these approaches could be 
used to make recommendations to improve and develop Pulmonary 
Rehabilitation Programmes across health-care contexts. 

Data availability 

Figshare: Nominal Group Technique consultation of a Pulmonary 
Rehabilitation Programme Data Set, doi: 10.6084/m9. figshare. 
928540-^1 
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The article gives a clear introduction to the concept of Pulmonary Rehabilitation (PR) acknowledging the 
evidence supporting the intervention and the positive impact that is has on participants lives post 
programme. Most importantly, it seeks to gather the opinions of "significant others" and professionals 
within the clinical team, something that is often overlooked but that could be a key component in service 
development. 

There is a clear introduction to the use of the Nominal Group Technique and its usefulness in facilitating 
all participants' views to be gathered and the aim of providing a rank of perceived benefits and challenges 
in pulmonary rehabilitation is clearly stated. 



The authors have used the Nominal Group Technique successfully to provide a useful ranking of themes 
and challenges from the perspectives of patients, professionals and significant others. These are useful to 
challenge current assumptions within Pulmonary Rehabilitation Programmes, but the study would benefit 
from consideration of the socio-demographics of the group as these also impact on health related 
outcomes. The small sample size also makes it difficult to generalise to a wider population, something 
which the authors themselves acknowledge. There is also a strong male bias in the sample group, what 
affect did this have on the results? 



The data and techniques used are clearly described and well presented and are representative and 
reflective of findings in the clinical setting. 



In conclusion, going forwards further research is required to establish whether the rankings are concurrent 
across the country, and if so do they have a role in guiding PR and assisting patients and significant 
others in overcoming the perceived barriers. Many of the themes and issues identified are already known 
to those working within the clinical setting and are addressed through education and management within 
PR in the UK already. There are also assumptions in practice that patients "Learn" as is stated on page 6 
in the Thematic Template generation. How is this evidenced? One finding that the authors also highlight is 
that significant others have more time for themselves as patients become more independent therefore 
supporting the self management of PR; this would benefit from further exploration. 

I have read this submission. I believe that I have an appropriate level of expertise to confirm that 
it is of an acceptable scientific standard. 



Competing Interests: No competing interests were disclosed. 
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STUDY PURPOSE 

The purpose of the present study was to describe the perceived benefits and challenges of pulmonary 
rehabilitation program for patients with COPD from the point of view of patients, professionals, and 
significant others (carers). 

TITLE AND ABSTRACT 

The title reflects the content of the article. The abstract provides a suitable summary of the work. The 
conclusion would be strengthened by a main message. 

INTRODUCTION 

The introduction provides detailed information about the area of research, gaps in the literature, and 
techniques employed to answer the research question. The references to the relevant literature on the 
mixed method design were also provided in order to support the proposed methodology. 

METHODS 

The design of the study was also described clearly, including thematic generation and consensus, as well 
as responsibilities for integration. However, the authors state that the focus is on the quantitative analysis 
rather than the qualitative analysis, yet the analysis described appears to be qualitative in nature, and the 
authors comment on the need to maintain qualitative rigour throughout the study. A ranking by median 
scores by the participants is still qualitative in nature. If the intent is to undertake a quantitative analysis of 
the data, the selection of the median rank and interquartile ranges as appropriate statistical tests that is 
meant to answer the study research question seems insufficient. The authors might want to explore the 
differences between the different groups in regard to the perceived benefits and challenges of pulmonary 
rehabilitation program for patients with COPD. We consider that there is a need for clearly stating the 
hypothesis being tested and a motivation for selecting specific statistical analysis, should a quantitative 
analysis be intended. The individual data table would be better presented in the results section. 

RESULTS 

The results section is appropriately explained, but the emphasis is again placed on the qualitative than 
quantitative research findings. In addition, the authors state that 20 participants were initially included in 
the study (8 patients, 8 professionals and 4 others) and 12 participants were finally included in the 
analysis. Given the small sample size, there is also a need to specify the status of the participants who did 
not complete the study. This information may influence the interpretation of the study results. There is also 
a disagreement between the evaluable responses across the paper: 60% on the page 6 versus 70% on 
the page 9. The authors also state that COPD patients who were currently participating in or completed a 
pulmonary rehabilitation program within the last 2 years were approached to participate in the study. 
However, Table 1 shows 2005 as year of PR program for one COPD patient. It is also worth mentioning 
the weak participation of physiotherapists in this study, although the pulmonary rehabilitation program 
was the main component of this research and the physiotherapists play a significant role in the delivery of 
pulmonary rehabilitation program. The thematic template generation does not offer clear guidance to the 
reader on what are the clear benefits and challenges - the list is somewhat self-evident and simplistic. 
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and appears to focus on the benefits of the pulmonary rehabilitation program, but the challenges are not 
clearly articulated. 

DISCUSSION 

The conclusions are generally balanced and justified, although special emphasis is placed on the 
qualitative findings. Some of the discussion would be better suited to the results. The main benefits and 
challenges of pulmonary rehabilitation for patients, carers, and professionals as presented in the themes 
are not specific enough to be of use for making recommendations for improving the pulmonary 
rehabilitation program. 

We have read this submission. We believe that we have an appropriate level of expertise to 
confirm that it is of an acceptable scientific standard, however we have significant reservations, 
as outlined above. 

Competing Interests: Pat Camp is a member of the Canadian Thoracic Society COPD Clinical 
Assembly and is involved in the development of guidelines for use in COPD. 
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Approved: 05 March 2014 

Referee Report: 05 March 2014 
doi:1 0.5256/f 1 000research.3790.r3648 

This is an interesting and useful article that explores the implications and lived experience of people 
dealing with the challenges of a debilitating chronic disease (COPD). This is not a "sexy" area of health 
care research but it is an important one as COPD substantially limits life in both quantity and quality. As 
such it is a worthy area of investigation, as the aim of this article is to identify how to improve the delivery 
of service for a sometimes overlooked patient group. 

The article is well presented and reflects a high level of attention to detail in design and analysis. The 
research team has identified an appropriate method of investigation which is sufficiently novel to generate 
new knowledge that will potentially inform clinical practice. Details of the data collection and analysis 
processes are well presented and the data are discussed comprehensively. The research team 
acknowledges that there are limitations in the study in terms of the level of participants, and the level 
of geographical specificity of the study. Whilst this is a sensible approach such caveats should not detract 
from the potential value of the study for practitioners who deliver such programmers. Finally, the 
conclusions are well balanced and insightful with a clear pathway to future research identified. 

I have read this submission. I believe that I have an appropriate level of expertise to confirm that 
it is of an acceptable scientific standard. 

Competing Interests: No competing interests were disclosed. 
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